Pre-assessment judgement framework for judging nursing students' performance in clinical placements: A qualitative case study.

AIM: This study aims to better understand and articulate the pre-assessment judgement processes commonly used by experienced clinical facilitators when assessing nursing students undertaking clinical placement. BACKGROUND: In the Australian context, clinical facilitators are registered nurses who primarily educate, monitor, support and assess groups of nursing students on clinical placements without carrying a patient load. The duties and scope of clinical facilitators may differ across international and institutional contexts. However, the core concepts of this paper will be relevant despite these differences as the importance of facilitators' confidence in making pre-assessment judgements of individual nursing student performance while on placement is universally acknowledged. Nursing students are often assessed on their provision of safe practice, patient task-orientated outcomes and professional behaviour. Clearly articulating performance judgements prior to formal assessment is vital to ensure progressive learning of students. Literature reports that many clinical facilitators lack confidence in the art of making performance judgements and call for targeted professional training and support in the clinical assessment of nursing students. To better understand and address this problem, clinical facilitators need a shared understanding of how individual nursing students' pre-assessment performance judgements are reached during placement experiences. DESIGN: A qualitative case study was used, with data collected via semi-structured interviews. Fifteen Australian clinical facilitators participated, each with over six months of experience. METHODS: Interview transcripts were analysed through an interpretive-constructivist paradigm. Thematic analysis revealed themes that were then deductively described through the application of the Cognitive Continuum Theory. RESULTS: Six modes of pre-assessment judgement emerged from the data synthesis process: 1) Recognising patterns, 2) Acknowledging uncertainty, 3) Understanding key players, 4) Verifying or refuting the information, 5) Benchmarking performance and 6) Contextualising information. Each mode is validated through the deductive application of the Cognitive Continuum theory. CONCLUSIONS: Understanding how experienced clinical facilitators make pre-assessment performance judgements has the potential to increase confidence in performance judgement decisions. In turn, confidence in judgements will increase clinical facilitator's capacity to give nursing students feedback that can be explained and justified. The pre-assessment judgement framework also provides a preliminary model for teaching the art of reaching accurate performance judgements to clinical educators in disciplines beyond nursing.

Education leads to increased adherence to the 'Australian Competency Standards for Occupational Therapy Driver Assessors'.

BACKGROUND: Occupational therapy competency standards provide an evidence-base to inform clinical best practice, however it is not known whether education about competency standards will increase occupational therapists' adherence to their use. AIMS/OBJECTIVES: To investigate if education about the 'Australian Competency Standards for Occupational Therapy Driver Assessors' leads to increased adherence to the competency standards in the clinical practice of occupational therapy driver assessors. MATERIALS AND METHODS: A mixed methods multiple case study design was used to evaluate 5 occupational therapy driver assessors' adherence to the competency standards. An audit of 25 client files and interviews were conducted to evaluate practice against the competency standards prior to an education session, followed by an audit of a further 25 files, interview and feedback after education. RESULTS: Qualitative and quantitative analyses suggest that education about the 'Australian Competency Standards for Occupational Therapy Driver Assessors' was associated with increased adherence to the competency standards in clinical practice. The results also support the use of competency standards in clinical practice. CONCLUSIONS AND SIGNIFICANCE: Competency standards can be used to inform and guide clinical practice, and individualised education and feedback of practice against the competency standards can increase occupational therapists' adherence to these standards.

Conducting Health Literacy Research With Hard-to-Reach Regional Culturally and Linguistically Diverse Populations: Evaluation Study of Recruitment and Retention Methods Before and During COVID-19.

BACKGROUND: In health research, culturally and linguistically diverse (CALD) health care consumers are cited as hidden or hard to reach. This paper evaluates the approach used by researchers to attract and retain hard-to-reach CALD research participants for a study investigating health communication barriers between CALD health care users and health care professionals in regional Australia. As the study was taking place during the COVID-19 pandemic, subsequent restrictions emerged. Thus, recruitment and retention methods were adapted. This evaluation considered the effectiveness of recruitment and retention used throughout the pre-COVID and during-COVID periods. OBJECTIVE: This evaluation sought to determine the effectiveness of recruitment and retention efforts of researchers during a study that targeted regional hard-to-reach CALD participants. METHODS: Recruitment and retention methods were categorized into the following 5 phases: recruitment, preintervention data collection, intervention, postintervention data collection, and interviews. To compare the methods used by researchers, recruitment and retention rates were divided into pre-COVID and during-COVID periods. Thereafter, in-depth reflections of the methods employed within this study were made. RESULTS: This paper provides results relating to participant recruitment and retainment over the course of 5 research phases that occurred before and during COVID. During the pre-COVID recruitment phase, 22 participants were recruited. Of these participants, 15 (68%) transitioned to the next phase and completed the initial data collection phase. By contrast, 18 participants completed the during-COVID recruitment phase, with 13 (72%) continuing to the next phase. The success rate of the intervention phase in the pre-COVID period was 93% (14/15), compared with 84.6% (11/13) in the during-COVID period. Lastly, 93% (13/14) of participants completed the postintervention data collection in the pre-COVID period, compared with 91% (10/11) in the during-COVID period. In total, 40 participants took part in the initial data collection phase, with 23 (58%) completing the 5 research phases. Owing to the small sample size, it was not determined if there was any statistical significance between the groups (pre- and during-COVID periods). CONCLUSIONS: The success of this program in recruiting and maintaining regional hard-to-reach CALD populations was preserved over the pre- and during-COVID periods. The pandemic required researchers to adjust study methods, thereby inadvertently contributing to the recruitment and retention success of the project. The maintenance of participants during this period was due to flexibility offered by researchers through adaptive methods, such as the use of cultural gatekeepers, increased visibility of CALD researchers, and use of digital platforms. The major findings of this evaluation are 2-fold. First, increased diversity in the research sample required a high level of flexibility from researchers, meaning that such projects may be more resource intensive. Second, community organizations presented a valuable opportunity to connect with potential hard-to-reach research participants.

The revision of competency standards for occupational therapy driver assessors in Australia: A mixed methods approach.

INTRODUCTION: Competency standards outline the knowledge, skills, and attributes that are required for competent practice. This study describes the process followed to revise and validate the competency standards for occupational therapy driver assessors in order to guide clinical practice in this area of advanced occupational therapy practice. METHODS: A mixed methods research approach was used in this study. In phase 1, three focus groups with driver assessors reviewed and suggested revisions to the competency standards for occupational therapy driver assessors. Phase 2 involved content validation with key stakeholders through a focus group with consumers, written feedback from Australian state, and territory driver licensing authorities, and a two-round Delphi process with Australian occupational therapy driver assessors. RESULTS: Forty-nine occupational therapy driver assessors participated in the phase 1 focus groups. Deductive content analysis of the transcripts provided data to revise the competency standards. Inductive analysis provided an in-depth understanding of the participants' views and was interpreted through six categories and their underlying subcategories: purposes and benefits; jurisdictional variations and practice diversity; language use; defining competent practice; challenging systems and processes; and competency standards content. Forty-eight occupational therapy driver assessors participated in the Delphi process. In Round 1, only 1 of the 164 competency standards and practice behaviours rated did not achieve the pre-determined 70% consensus rate. In Round 2, all statements achieved consensus, with the overall average consensus level obtained across the Round 2 statements at 96.8%. CONCLUSION: The revised Australian Competency Standards for Occupational Therapy Driver Assessors have been endorsed by Occupational Therapy Australia and released for clinical use. The methods described in this research provide a framework suitable for revision or development of competency standards in both other areas of occupational therapy practice and other health-care professions.